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(54) Methods and apparatus for the provision o1 user selected advanced closed captions 



(57) User customizable advanced closed caption 
capabilities are provided using closed caption informa- 
tion, such as that described in the Electronic Industries 
Association (El A) Television Data Systems Subcommit- 
tee standards, El A-608 or EIA-708. The invention allows 
the user to override the closed caption presentation for- 
mat as selected by the originator (e.g., programmer or 
broadcaster), in order to select alternate presentation 
attributes based on the user's preference. The invention 
may also be implemented to customize other fomns of 
text information (e.g., subtitles.). The invention also al- 
lows for storage and subsequent retrieval and review of 
text included within the closed caption infonnation, 
which text sen/es as a transcript of the program. The 
methods and apparatus provided are independent of the 
type of delivery network, content formal, and receiver 
type. In an example embodiment, closed caption infor- 
mation is extracted (e.g., by a closed caption processor 
20) from a television signal 1 0, which television signal 
10 also contains corresponding audiovisual program- 
ming. The processor 20 detemnines whether one or 
more user selected attributes 12 have been set. At least 
one user selected attribute 12 is applied to at least a 
portion of the closed caption information (e.g., via a 
closed caption driver 30). The ctosed caption infonma- 
tion is displayed (e.g., via a display driver 40 and graph- 
ics processor 45) on a display device 50 (e.g.. a televi- 
sion screen) in accordance with the user selected at- 
tributes 12 via a graphical overiay on top of the audio- 
visual programming. In this manner, user selected ad- 



vanced closed caption features can be provided using 
existing closed caption infomiation contained in the tel- 
evision signal. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates generally to the 
provision of closed captioning for television and other 
audiovisual programming. In particular, the present In- 
vention provides advanced closed caption features us- 
ing existing closed caption information carried in the tel- 
evision signal. The invention allows a user to override 
the closed caption presentation format as selected by 
the originator (e.g., programmer or broadcaster), in or- 
der to select alternate presentation attributes based on 
the user's preference. User customizable advanced 
closed caption features are provided, such as font size, 
font type, font color, caption window position, caption 
window size, print direction, scroll direction, scroll rate, 
text opacity, background opacity, text justification left, 
text justification right, text justification center, back- 
ground color, and the like. 

[0002] Closed captions are captions that are hidden 
in the video signal. Recovery of closed captions for dis- 
play along with the television programming requires a 
closed caption decoder to be used in connection with 
the television receiver. 

[0003] Beginning around 1980, closed captioning of 
video programs in the United States utilized Line 21 of 
the Vertical Blanking Interval (VBI) of a National Televi- 
sion Standards Committee (NTSC) television signal to 
carry closed caption data. In 1990, Congress passed the 
TV Decoder Circuitry Act, which required closed caption 
decoders In most television receivers. The TV Decoder 
Circuitry Act required the Federal Communications 
Commission (FCC) to produce standards for closed 
caption decoders. The FCC, with assistance from the 
Electronic Industries Association (EIA) Television Data 
Systems Subcommittee, has developed certain stand- 
ards for the delivery of closed captions, including the 
EIA-608 and the EIA-708 standards. One technique for 
communicating VBI data, such as closed captions, in 
digital television data streams is disclosed in commonly 
assigned U.S. patent no. 5,844,615, entitled Communi- 
cation of VBI Data in Digital Television Data Streams, 
incorporated herein by reference. 
[0004] The EIA-608 standard, developed In 1991, Is 
based on the Line 21 system and utilizes the DVS-i57 
standard for carriage format of the EIA-608 captions in 
digital cable systems. DVS-157 is a standard that has 
been established for the cable industry by the Digital 
Video Subcommittee (DVS) of the Society of Cable Tel- 
ecommunications Engineers ("SCTE"). The EIA-608 
closed captions are provided in a single, unalterable 
configuration. 

[0005] The EIA-708 standard is a new standard which 
was developed in recent years and which utilizes the 
carriage format specified in the Advanced Television 
System Committee's (ATSC) A/53 standard for digital 
video. The EIA-708 standard is meant to provide 'ad- 



vanced" closed caption features in digital television sig- 
nals at the Closed Captioning origination device. The- 
EIA-708 "advanced" features include, but are not limited 
to, the ability to change certain closed caption features, 

5 such as the location of the closed caption display, and - 
the size and color of the closed caption text. 
[0006] The A/53 f omnat used by the EIA-708 standard 
is not backward compatible with existing digital cable 
systems. Millions of existing set-top terminals currently 

10 in use by consumers support the EIA-608 standard car- 
ried digitally in DVS-157. These set-top terminals are 
incapable of being upgraded to accommodate the A/53 
format utilized in the EIA-708 standard. Replacing the 
existing set-top temninals with EIA-708 compatible sys- 

15 terns would be costly to consumers and operators alike. 

SUMMARY OF THE INVENTION 

[0007] The present invention relates generally to the 

20 provision of closed captioning for television and other 
audio-visual programming. In particular, the present in- 
vention provides user customizable advanced closed 
caption features using existing closed caption informa- 
tion carried in the television signal. The user customiz- 

25 able advanced closed caption features include featu res 
such as font size, font type, font color, caption window 
position, caption window size, print direction, scroll di- 
rection, scroll rate, text opacity, background opacity, text 
Justification left, text justification right, text justification 

30 center, background color, and the like. Closed caption 
infomnation is extracted (e.g., by a closed caption proc- 
essor) from a television signal, which television signal 
also contains corresponding television programming. 
The processor detemnines whether one or more userse- 

35 lected attributes have been set. At least one user select- 
ed attribute Is applied to at least a portion of the closed 
caption information (e.g., via a closed caption driver). 
The closed caption information Is displayed (e.g., via a 
display driver and graphics processor) on a display de- 

40 vice (e.g., a television screen) in accordance with the 
user selected attributes via a graphical overiay on top 
of the television programming. In this manner, user se- 
lected advanced closed caption features can be provid- 
ed at the display device using existing closed caption 

45 infomiation contained within the television signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] The present invention will hereinafter be de- 
50 scribed in conjunction with the appended drawing fig- 
ures, wherein like numerals denote like elements, and: 

Figure 1 shows a block diagram of an exemplary 
embodiment of the invention; 

55 

Figure 2 shows a block diagram of a further exem- 
plary embodiment of the invention; 
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Figure 3 shows a block diagram of a preferred em- 
bodiment of the invention; 

Figure 4 shows an example of a menu box for en- 
tering the user selected advanced closed caption 
attributes; and 

Figure 5 shows a further example of a menu box for 
entering additional user selected advanced closed 
caption attributes. 

DETAILED DESCRIPTION OF THE INVENTION 

[0009] The ensuing detailed description provides pre- 
ferred exemplary embodiments only, and is not intended 
to limit the scope, applicability, or configuration of the 
invention . Rather, the ensuing detailed description of the 
preferred exemplary embodiments will provide those 
sl<illed in the art with an enabling description for imple- 
menting a preferred embodiment of the invention. It 
should be understood that various changes may be 
made in the function and arrangement of elements with- 
out departing from the spirit and scope of the invention 
as set forth in the appended claims. 
[0010] The invention is described in connection with 
closed caption information, which should be understood 
to include not only closed caption text, but also any other 
information necessary for the display of closed captions, 
including but not limited to contextual and graphical in- 
fomiation. However, it should be appreciated by those 
skilled in the art that the invention is not limited to cus- 
tomizing of traditional closed caption infomnation. The 
invention can also be Implemented to allow for custom- 
ization of any type of textual information contained with- 
in or associated with a video signal, such as subtitles, 
stock tickers, advertising banners, emergency alert sig- 
nals, and the like. 

[0011] Figure 1 is a block diagram of an exemplary 
embodiment of the present invention. A television signal 
10 containing closed caption information and associat- 
ed television programming is provided to a processor 
20. User selected closed caption attributes 12 are also 
provided to the processor 20. The processor 20 extracts 
the closed caption information. The user selected at- 
tributes 1 2 are applied to at least a portion of the extract- 
ed closed caption information by a closed caption driver 
30. A display driver 40 provides the closed caption in- 
fomnation with user selected attributes to a graphics 
processor 45. The graphics processor 46 provides the 
closed caption information with the user selected at- 
tributes applied thereto to a display device 50. The 
closed caption driver 30 and the display driver 40 may 
be Implemented, e.g., as software or firmware on or as- 
sociated with the processor 20. The graphics processor 
45 is implemented in hardware and firmware. 
[0012] As shown in Figure 2, the television signal 10 
may be received at a tuner 60 and demodulated at de- 
modulator 70 prior to the extracting of the closed caption 



infomnation at the processor In addition, if scrambled, 
the television signal 1 0 will be descrambled at descram- 
bler 80 prior to the extracting of the closed caption in- 
formation. It should be appreciated by those skilled In 
5 the art that a standard MPEG-2 transport and video 
processor will also be necessaiy for processing digital 
data streams. This MPEG processor can be implement- 
ed as part of processor 20 or as a separate processor 
associated therewith. Those skilled in the art will appre- 
10 ciate that the digital television signal is forwarded from 
the video processor (VDP) on the bus to a graphics proc- 
essor. Next the signal is forwarded to a device that con- 
trols bus and burst mode digital video transfers, then the 
signal is forwarded to where VBI insertion is perfomned 
15 (from the infomnation fonwarded to it) and finally digital/ 
analog (NTSC) conversion is perfomned. 
[0013] In a prefen-ed embodiment of the invention as 
shown in Figure 3, user selected advanced closed cap- 
tions are provided. Closed caption information is ex- 
20 tracted (e.g., by a closed caption processor 20) from a 
television signal 10, which television signal also con- 
tains corresponding television programming. The proc- 
essor 20 detemnines whether one or more user selected 
attributes 12 have been set. At least one user selected 
25 attribute 12 Is applied to at least a portion of the closed 
caption information (e.g., via a closed caption driver 30). 
The closed caption infomnation is displayed (e.g., via a 
display driver 40 and graphics processor 45) on a dis- 
play device 50 (e.g., a television screen) in accordance 
30 with the user selected attributes 1 2 via a graphical over- 
lay on top of the television programming. In this manner, 
user selected advanced closed caption features can be 
provided using existing closed caption information con- 
tained within the television signal. 
35 [0014] The invention may be implemented as part of 
a set-top terminal, a digital television, a personal com- 
puter, a digital video recorder, a digital video disk player, 
or other suitable device. Alternatively, the Invention may 
be implemented in a stand-alone device 200 as shown 
40 in Figure 3 which receives a television or other video 
signal 1 0 and is coupled to a display device 50. The user 
selected attributes may be applied to closed caption in- 
formation which is received (along with corresponding 
television programming) via a personal versatile record- 
45 er (PVR), a set-top temninal, a digital television, a per- 
sonal computer, a video cassette recorder, a digital vid- 
eo recorder, a digital video disk player, or similar device. 
In the altemative, the television signal 1 0 containing the 
closed caption information and associated television 
so programming may be received via a delivery network, 
such as a cable or satellite television network, a terres- 
trial network, the Internet, or other suitable communica- 
tion network. Those skilled in the art will appreciate that 
the television signals discussed herein include not only 
55 traditional types of television signals, but also any non- 
traditional television signals containing closed caption 
or other textual data. For example, the television signal 
10 may comprise an analog signal, a broadcast or on- 
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demand digital signal, singlecast or multicast streaming 
media, and the like. 

[0015] The user selected attributes 12 may include 
font size, font type, font color, caption window position, 
caption window size, print direction, scroll direction, 
scroll rate, text opacity, background opacity, text justifi- 
cation left, text justification right, text justification center, 
background color, and the like. 

[0016] The closed caption infomiation may be dis- 
played in one or more closed caption boxes. Multiple 
closed caption boxes may be displayed simultaneously 
(e.g., for use with picture-in-plcture features or to pro- 
vide viewing of the closed caption text for more than one 
channel while viewing a single television program). 
[001 7] The closed caption Information may be tagged 
with an identifier that distinguishes it from the television 
programming data. The closed caption information can 
then be extracted from the television signal based on 
the identifier. The television signal may comprise an 
MPEG-2 transport stream. The closed caption Infomia- 
tion may be carried in a user data field of video data 
syntax of the MPEG-2 transport stream. In such an em- 
bodiment, extracting the closed caption information may 
be performed based on the user data field. This applies 
when working with, for example, EIA-608 standard 
closed caption infomiation. Pursuant to the EIA-608 
standard, closed caption bytes in DVS-157 are deliv- 
ered in the user_data syntax of the video syntax of DVS- 
018, which is compatible with the video syntax of A/53, 
an ATSC Digital Television Standard. The encoder (at 
the origination location) incorporates the caption bytes, 
as fonwarded via one of its interfaces, following the syn- 
tax in user_adata of the video syntax of a digital stream. 
The decoder (e.g., set-top temninal), when decoding a 
digital stream receives these bytes in the aforemen- 
tioned format, extracts them and transcodes them as an 
EIA-608 VBI signal on the analog signal. This analog 
signal is a result of the decoder decoding the digital 
(MPEG-2) stream and converting it to an analog NTSC 
signal. 

[0018] The closed caption infonnation may comprise 
one of EIA-608 closed caption information or EIA-708 
closed caption information. 

[001 9] The user selected attributes can be entered via 
a pop-up menu, a dialogue box, a pull-down window 
menu, or other suitable mechanism or combination of 
mechanisms. For example, Figure 4 shows a menu 300 
of user selectable closed caption attributes. Figure 4 
shows closed caption box attributes 305 such as box 
position 31 0, box width 31 5, box height 320, border 325, 
opacity 330, box color 335, priority 340, show caption 
box 345, lock row growth 350 and lock column growth 
355. Closed caption text attributes 360 are also shown, 
including justification 365, font size 370, opacity 375, 
font type 380, font color 385, and anchor point 390. Fig- 
ure 5 shows a menu 400 of closed caption configuration 
tags, such as those provided pursuant to the EIA-708 
standard, which indicate the type of text content being 



displayed. The tags 41 0 include indicators of such as 
dialog (nonnal words spoken by characters in the pro-> 
gramming), source or speaker Identification (name of 
the speaker or source of sound), electronically repro- 

5 duced voice (spoken audio from a phone, radio, PA sys- - 
tern, and the like), dialog in language other than primary 
program language, voiceover (narration or other disem- 
bodied voice not heard by the program's characters), 
audible translation (voice of disembodied translator not 

10 heard by the program's characters), subtitle translation 
(text showing a translation into the primary language of 
the program), voice quality description (description of a 
voice quality), song lyrics (words being sung), sound ef- 
fect description (a description of a nonverisal sound or 

15 music being heard by the program's characters), musi- 
cal score description (a description of background music 
not heard by the character's in the program), expletive 
(an interjectory word or expression, possibly profane or 
harsh). 

20 [0020] As shown in Figure 3, the user selected at- 
tributes may be stored in memory 90. Multiple attribute 
settings may be provided such that different users can 
store their respective preferred attributes for future use. 
[0021 ] In a preferred embodiment of the invention , the 

25 processor 20 may dynamically determine the location of 
one or more objects of interest in a displayed television 
scene. Once an object of interest is identified, at least 
one of the user selected attributes 1 2 can be adjusted 
to make the presence of the displayed closed caption 

30 information less distracting based on the location of the 
one or more objects of Interest. 

[0022] The closed caption information may be stored 
in memory 90. The closed caption infomiation may be 
stored on one of a personal versatile recorder, a digital 

35 television, a digital video recorder, a digital video disk 
player, a set-top terminal, a personal computer, or other 
suitable device. The user selected attributes 12 may in- 
clude the option of automatically generating a transcript 
of the television programming from the stored closed 

40 caption information. The transcript may then be printed 
from an associated printer 100. 

[0023] User controlled replay of the stored closed 
caption infonnation may be provided. On-screen review 
of closed caption text from the stored closed caption in- 
45 formation may also be provided, which may be by a full 
screen display or a partial screen display. Page num- 
bers, time and date, and program title may be inserted 
into the stored closed caption information. 
[0024] Closed caption text from the stored closed cap- 
so tion infonnation may be transfen-ed to writeable media. 
The writeable media may comprise memory 90 con- 
tained within the same device which provides the ad- 
vanced closed caption features. In the alternative, the 
writeable media may be .located in a device separate 
55 from that which provides the advanced closed caption 
features. For example, the closed caption text from the 
stored closed caption information may be transferred (e. 
g., in Rich Text Fonmat (RTF)) to a personal computer 
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110 for storage on a hard drive, CD ROM, diskette, or 
• any other suitable storage device. Similarly, the closed 

caption text nnay also be transferred to a printer 100, a 

personal versatile recorder (PVR) 120, a digital televi- 
' sion, a digital video recorder, a digital video disk player, 

a set top terminal, or other suitable device for further 

personal use or manipulation. 

[0025] File management functions may be provided 
for multiple stored closed caption files, wherein each 
stored closed caption file corresponds to a single tele- 
vision program. The file management functions may be 
provided by a personal versatile recorder 120, a digital 
video recorder, a digital television, a digital video disk 
player, a set-top terminal, a personal computer 110, or 
other suitable device. 

[0026] Bookmarks may be inserted and subsequently 
located in the closed caption text of the stored closed 
caption information by a user via, e.g., remote control. 
[0027] In an alternate embodiment, the currently dis- 
played closed caption Information may be removed after 
a predetermined time period in which no closed caption 
Infomriation is received. 

[0028] In a further embodiment of the invention, dy- 
namic adjustment of closed caption text color Is provid- 
ed when a transparent closed caption background is se- 
lected. When a transparent background Is selected, the 
closed caption text is presented directly over the televi- 
sion programming. As the color of the displayed televi- 
sion programming may change periodically, there exists 
the possibly of conflict with the chosen color of the 
closed caption text. By dynamically adjusting text color 
the closed caption text will always be visible over the 
television programming. Those skilled in the art will ap- 
preciate that such dynamic adjustment is more appro- 
priately provided at the origination site rather than at a 
destination location due to the difficulty in the processing 
(real-time) which would be required at the destination or 
viewing location. 

[0029] Unicode character technology may be utilized 
in order to provide internationalization of the closed cap- 
tion infomnation. Unicode is an international standard for 
representing strings (concatenated characters) using 
1 6-bit characters (65,536 possible characters). The Uni- 
code standard allows for non-English alphabet charac- 
ters and graphical symbols. 

[0030] In an alternate embodiment of the invention, 
the user selected attributes 12 may be automatically 
overridden when an Emergency Alert Signal is received 
in order to avoid overiap of the displayed closed caption 
information with a display of the Emergency Alert Signal. 
[0031] The user selected attributes may be disabled 
on a per program basis or a per channel basis. 
[0032] It should now be appreciated that the invention 
provides advantageous methods and apparatus which 
albw user selectable advanced closed caption features 
to be generated using existing closed caption informa- 
tion. Further, the present Invention accommodates both 
the EIA-608 standard and the EIA-708 standard closed 



captions. 

[0033] Although the invention has been described in 
connection with various illustrated embodiments, nu- 
merous modifications and adaptations may be made 
5 thereto without departing from the spirit and scope of 
the invention as set forth in the claims. 



Claims 

10 

1. A method for provision of user selected advanced 
closed captions, comprising the steps of: 

extracting closed caption information from a tel- 
15 evision signal having corresponding television 

programming; 

determining whether one or more user selected 
attributes have been set; 
applying at least one user selected attribute to 
20 at least a portion of the closed caption informa- 

tion; and 

displaying the closed caption information on a 
display device in accordance with the user se- 
lected attributes via a graphical overlay on-top 
25 of the television programming. 

2. A method in accordance with claim 1 , wherein: 

the television signal is received, demodulated, 
30 and descrambled prior to said extracting of said 

closed caption information. 

3. A method in accordance with claim 1 or 2, wherein 
the user selected advanced closed caption at- 

35 tributes are applied to closed caption information re- 
ceived via one of a delivery network, a personal ver- 
satile recorder (PVR), a set-top terminal, a digital 
television, a personal computer, a video cassette 
recorder, a digital video recorder, or a digital video 

40 disk player. 

4. A method in accordance with one of claims 1 to 3, 
wherein the provision of user selected advanced 
closed captions occurs at one of a personal versa- 

45 tile recorder (PVR), a set-top tenminal, a digital tel- 
evision, a personal computer, a digital video record- 
er, or a digital video disk player. 

5. A method in accordance with one of claims 1 to 4, 
50 wherein the user selected attributes comprise at 

least one of font size, font type, font color, caption 
window position, caption window size, print direc- 
tion, scroll direction, scroll rate, text opacity, back- 
ground opacity, text justification left, text justification 
55 right, text justification center, and background color. 

6. A method in accordance with one of claims 1 to 5, 
wherein: 



20 
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the closed caption information is displayed in 
one or more closed caption boxes. 

7. A method in accordance with claim 6, wherein mul- 
tiple closed caption boxes are displayed simultane- s 
ously. 

8. A method in accordance with one of claims 1 to 7, 

wherein: 

10 

the closed caption information is tagged with an 
identifier that distinguishes it from television 
programming data; and 
the closed caption infomnation is extracted 
based on the identifier. is 

9. A method in accordance with one of claims 1 to 8, 
wherein: 

the television signal comprises an MPEG-2 20 
transport stream; 

the closed caption information is carried in a us- 
er data field of video data syntax of the MPEG- 
2 transport stream; and 

the closed caption information is extracted 25 
based on the user data field. 

10. A method in accordance with one of claims 1 to 9, 
wherein said closed caption infonnation comprises 
one of EIA-608 closed caption information or El A- 30 
708 closed caption information. 

11. A method in accordance with one of claims 1 to 10, 
wherein the user selected attributes are entered via 

at least one of a pop-up menu, a dialogue box, and 35 
a pull-down window menu. 

12. A method in accordance with one of claims 1 to 11, 
further comprising the step of: 

40 

storing the user selected attributes in memory. 

13. A method in accordance with one of claims 1 to 12, 
further comprising the steps of: 

45 

dynamically detenrilnlng the location of one or 
more objects of interest in a displayed televi- 
sion scene; and 

automatically adjusting at least one of the user 
selected attributes to make the presence of the so 
displayed closed caption infonnation less dis- 
tracting based on the location of the one or 
more objects of Interest. 

14. A method in accordance with one of claims 1 to 1 3, ss 
comprising the further step of: 

storing the closed caption infomnation in mem- 



ory. 

15. A method in accordance with claim 14, wherein the 
closed caption infonnation is stored on one of a per- 
sonal versatile recorder, a digital television, a digital - 
video recorder, a digital video disk player, a set-top 
terminal, or a personal computer. 

16. A method in accordance with claim 14 or 15, where- 
in the user selected attributes include the option of 
automatically generating a transcript of the televi- 
sion programming from the stored closed caption 
Information. 

17. A method in accordance with claim 16, comprising 
the further step of printing the transcript. 

18. A method in accordance with one of claims 14 to 

1 7, comprising the further step of: 

providing user controlled replay of the stored 
closed caption information. 

19. A method in accordance with one of claims 14 to 

1 8, comprising the further step of: 

providing on-screen review of closed caption 
text from the stored closed caption information. 

20. A method in accordance with one of claims 1 4 to 

19, comprising the further step of: 

inserting into the stored closed caption informa- 
tion at least one of page numbers, time and 
date of storing, and television program title. 

21. A method in accordance with one of claims 14 to 

20, comprising the further step of transferring 
closed caption text from the stored closed caption 
Information to writeable media. 

22. A method in accordance with one of claims 14 to 

21 , comprising the further step of: 

transferring closed caption text from the stored 
closed caption Information to one of a printer, a 
personal versatile recorder (PVR), a digital tel- 
evision, a digital video recorder, a digital video 
disk player, a set top tenninat, or a personal 
computer. 

23. A method in accordance with one of claims 1 4 to 

22, comprising the further step of: 

providing file management functions for multi- 
ple stored closed caption files, 

wherein each stored closed caption file corre- 
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spends to a single television progrann. 

24. A method in accordance with claim 23, wherein said 
file management functions are provided by one of 
a personal versatile recorder, a digital television, a 5 
digital video recorder, a digital video disk player, a 
set -top terminal, or a personal computer. 

25. A method In accordance with one of claims 14 to 
24, comprising the further steps of: 

providing for the insertion of bookmarks into 
closed caption text of the stored closed caption 
information; and 

providing for the location of the bookmarks in- 
serted into the closed caption text. 

26. A method in accordance with one of claims 1 to 25, 
comprising the further step of: 

20 

removing displayed closed caption information 
after a predetermined time period in which no 
closed caption information is received. 

33. 

27. A nrwlhod in accordance with one of claims 1 to 26, 25 
comprising the further step of: 

providing dynamic adjustment of closed cap- 
lion text color when a transparent closed cap- 
tion background is selected. 



28. A method in accordance with one of claims 1 to 27, 
comprising the further step of: 

utilizing Unicode character technology for inter- 
nationalization of closed caption information. 

29. A method in accordance with one of claims 1 to 28, 
comprising the further step of: 

receiving an Emergency Alert Signal; and 
automatically overriding the user selected at- 
tributes in order to avoid overiap of the dis- 
played closed caption infonnation with a dis- 
play of the Emergency Alert Signal. 

30. A method in accordance with one of claims 1 to 29, 
wherein the user selected attributes can be disa- 
bled on at least one of a per program basis or a per 
channel basis. 

31. Apparatus for provision of user selected advanced 
closed captions, comprising: 

a processor for: 

extracting closed caption Infonnation from 
a television signal having conresponding 



television programming; 
determining whether one or more user se- 
lected attributes have been set; 

a closed caption driver for applying at least one 
user selected attribute to at least a portion of 
the closed caption infonnation; 
a display driver; and 

a graphbs processor for displaying the closed 
caption infonnation received from the display 
driver on a display device in accordance with 
the user selected attributes via a graphical 
overiay on top of the television programming. 

32. Apparatus in accordance with claim 31, further 
comprising: 

a receiver for receiving the television signal; 
a demodulator for demodulating the television 
signal; and 

a descrambler for descrambling the television 
signal. 

Apparatus in accordance with claim 31 or 32, 
wherein the user selected advanced closed caption 
attributes are applied to closed caption information 
received via one of a delivery network, a personal 
versatile recorder (PVR), a set-top terminal, a digital 
television, a personal computer, a video cassette 
recorder, a digital video recorder, or a digital video 
disk player. 

34. Apparatus in accordance with one of claims 31 to 
33, wherein the apparatus comprises one of a per- 

35 sonal versatile recorder (PVR), a digital television, 
a digital video recorder, a digital video disk player, 
a set top terminal, or a personal computer. 

35. Apparatus in accordance with one of claims 31 to 
40 34, wherein the user selected attributes comprise 

at least one of font size, font type, font color, caption 
window position, caption window size, print direc- 
tion, scroll direction, scroll rate, text opacity, back- 
ground opacity, text justification left, text justification 
45 light, text justification center, and background color. 

36. Apparatus in accordance with one of claims 31 to 
35, wherein: 

so the closed caption information is displayed in 

one or more closed caption boxes. 

37. Apparatus in accordance with claim 36, wherein 
multiple closed caption boxes are displayed simul- 

55 taneously. 

38. Apparatus in accordance with one of claims 31 to 
37, wherein: 



35. 



40 



45 
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the closed caption Information is tagged with an 
Identifier that distinguishes it from television 
programming data; and 
the closed caption infomnation is extracted 
based on the identifier. 

39. Apparatus in accordance with one of claims 31 to 

38, wherein: 

the television signal comprises an MPEG-2 

transport stream; 

the closed caption information Is carried In a us- 
er data field of video data syntax of the MPEG- 
2 transport stream; and 
the closed caption information is extracted 
based on the user data field. 

40. Apparatus in accordance with one of claims 31 to 

39, wherein said closed caption information com- 
prises one of El A-608 closed caption infonnation or 
EIA-708 dosed caption infomnation. 

41. Apparatus in accordance with one of claims 31 to 

40, wherein the user selected attributes are entered 
via at least one of a pop-up menu, a dialogue box, 
and a pull-down window menu. 

42. Apparatus In accordance with one of claims 31 to 

41 , further comprising: 

a memory device for storing the user selected 
attributes In memory. 

43. Apparatus In accordance with claim 31 , wherein: 

the location of one or more objects of Interest 
in a displayed television scene are dynamically 
detennlned; and 

at least one of the user selected attributes is 
automatically adjusted to make the presence of 
the displayed closed caption information less 
distracting based on the location of the one or 
more objects of interest. 

44. A method In accordance with one of claims 31 to 
43, further comprising: 

memory for storing the closed caption informa- 
tion. 

45. Apparatus in accordance with claim 44, wherein the 
apparatus comprises one of a personal versatile re- 
corder (PVR), a digital television, a digital video re- 
corder, a digital video disk player, a set top terminal, 
or a personal computer. 

46. Apparatus in accordance with claim 44 or 45, 
wherein the user selected attributes include the op- 



tion of automatically generating a transcript of the 
television programming from the stored closed cap- . 
tion Infonnation. 

5 47. Apparatus in accordance with claim 46, wherein the 
transcript is printed. 

48. Apparatus in accordance with one of claims 44 to 

47, wherein user controlled replay of the stored 
10 closed caption infonnation is provided. 

49. Apparatus in accordance with one of claims 44 to 

48, wherein on-screen review of closed caption text 
from the stored closed caption infonnation is pro- 

15 vided. 



50. Apparatus In accordance with one of claims 44 to 

49, wherein at least one of page numbers, time and 
date of storing, and television program title is insert- 

20 ed Into the stored closed caption Information. 

51 . A method in accordance with one of claims 44 to 

50, wherein closed caption text from the stored 
closed caption infonnation is transferred to writea- 

25 ble media. 

52. Apparatus In accordance with one of claims 44 to 

51 , wherein closed caption text from the stored 
closed caption infonnation is transferred to one of 

30 a printer, a personal versatile recorder (PVR), a dig- 
ital television , a digital video recorder, a digital video 
disk player, a set top terminal, or a personal com- 
puter. 

35 53. Apparatus in accordance with one of claims 44 to 

52, wherein the processor provides file manage- 
ment functions for multiple stored closed caption 
files, wherein each stored closed caption file corre- 
sponds to a single television program. 

40 

54. Apparatus in accordance with claim 53, wherein 
said apparatus comprises one of a personal versa- 
tile recorder, a digital television , a digital video re- 
corder, a digital video diskplayer, aset-top terminal, 

45 or a personal computer. 

55. Apparatus in accordance with one of claims 44 to 

54, wherein: 

50 inserting of bookmarks Into closed caption text 

of the stored closed caption Infonnation Is pro- 
vided for; and 

locating of the bookmarks Inserted into closed 
caption text of the closed caption infonnation is 
55 provided for. 

56. Apparatus in accordance with one of claims 31 to 

55. wherein the displayed closed caption informa- 
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tlon is removed after a predetermined time period 
In which no closed caption information is received. 

57. Apparatus in accordance with one of claims 31 to 

56, wherein closed caption text color is dynamically 
adjusted when a transparent closed caption back- 
ground Is selected. 

58. Apparatus in accordance with one of claims 31 to 

57, wherein Unicode character technology is uti- 
lized for internationalization of closed caption infor- 
mation. 

59. Apparatus in accordance with one of claims 31 to 

58, wherein: 

in the event an Emergency Alert Signal is re- 
ceived, the user selected attributes are auto- 
matically overridden in order to avoid overlap 
of the displayed closed caption information with 
a display of the Emergency Alert Signal. 
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60. Apparatus in accordance with one of claims 31 to 
59, wherein the user selected attributes can be dis- 
abled on at least one of a per program basis or a 
per channel basis. 

61. A method for the provision of user selected ad- 
vanced closed captions, comprising the steps of: 



extracting the closed caption information from 
a television signal having associated television 
programming; 

determining whether one or more user selected 
attributes have been set; 
applying at least one user selected attribute to 
at least a portion of the closed caption informa- 
tion; 

displaying the closed caption information on a 
display device in accordance with the user se- 
lected attributes via a graphical overlay on top 
of the television programming; 
dynamically determining the location of one or 
more objects of interest in a displayed televi- 
sion scene; and 

automatically adjusting at least one of the user 
selected attributes to make the presence of the 
displayed closed caption information less dis- 
tracting based on the location of the one or 
more objects of interest. 

62. Apparatus for the provision of user selected ad- 
vanced closed captions, comprising: 

a processor for: 

extracting the closed caption information 
from a television signal having associated 



30 



35 



40 



45 



so 



55 



television programming; 
determining whether one or more user se- 
lected attributes have been set; 

a closed caption driver for applying at least one 
user selected attribute to at least a portion of 
the closed caption information; and 
a display driver; 

a graphics processor for displaying the closed 
caption information received from the display 
driver on a display device in accordance with 
the user selected attributes via a graphical 
overlay on top of the television programming; 



wherein: 



the location of one or more objects of interest 
in a displayed television scene are dynamtoally 

determined; and 

at least one of the user selected attributes is 
automatically adjusted to make the presence of 
the displayed closed caption infonnation less 
distracting based on the location of the one or 
more objects of interest. ^ 



9 



BNSDOCIO: <EP 1237366A2J_> 



EP 1 237 366 A2 



TELBflSION 
SIGNAL 
10 



USER 




SELECTED 





ATTRIBUTES 




12 





PROCESSOR 
20 



CLOSED 
CAPTION DRIVER 
30 



Drsi 

DRI 

i 


PLAY 
VER 
10 




r 


GRAPHICS 
PROCESSOR 
45 



DISPLAY 

50 



FIG. 1 



BNSDOCID: <EP 123736eA2_l_> 



10 



EP 1 237 366 A2 



TELEVISION 
SIGNAL 
10 




r 


TUN 
6C 


ER 



DEMODULATOR 
70 



DESCRAMBLER 
80 



USER 
SELECTED 
ATTRIBUTES 
12 



PROCESSOR 
20 



CLOSED 
CAPTION DRIVER 
30 



DISPLAY 
DRIVER 
40 



I 



GRAPHICS 
PROCESSOR 
45 



FIG. 2 



DISPLAY 
50 



11 



BNSDOCID: <EP 1237366A2J_> 



EP 1 237 366 A2 




PRINTER 
100 




a. 


i 


i 


i 





CO 




12 



BNSOOCIO: <EP 1237366A2J_> 



EP 1 237 366 A2 



ia 



a> 

o 
c: 
o 
<-> 



O 

E 




C/3 



ill 

o a> o 

o. c 

^.S o 



S 



cn 

c: 

e 

E 

p 



a> 

o 
p 



' CO 
CO 

E S 



o o 



o 



o 

£2 J 

P CO 



o O 



o 5 
£ no « 



o 
E 

OL 



-5= o- 



o 

c: .o 

-O o 
:*3 > 



CO ^-^ 03 O v_ -pr 



CO 



S o 
<o^^ 



s 



M 

E 



i 
o 

=3 

CO a 



o 



o 



CO o 

P 



o 
cn 



a> 



CO 



o 



-2 
o 




8 
"g 

CO 

o 



CO 



«> 



09 



-1 

^ o 



□ □ □ □ 



14 



.1237366A2J_> 



(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(11) EP 1 237 366 A3 

EUROPEAN PATENT APPLICATION 





Dat8 of publication A3: 


(51) Intel 7 H04N 5/445 




01.12.2004 Bulletin 2004/49 




\**^} 


riatp of nuhllcation A2* 






04.09.2002 Bulletin 2002/36 




\^ ' / 


Application number: 02004810.4 




(22) 


Date of filing: 02.03.2002 




(B4) 


LJesignaiea ooniraciiny oLdit^b. 


• Reamer Sean Anthonv 


AT RP r'lA r^v np ni^ pi pr f^R f^R IP IT LI L U 


Lansdale Pennsvlvania 19446 (US) 




MC NL PT SE TR 


• Depietro, Marie 




Designated Extension States: 


Harleysville, Pennsylvania l943o (US) 




AL LT LV MK RO SI 


• Barlcley, Chuck 






Horsham, Pennsylvania 19044 (US) 


(30) 


Priority: 02.03.2001 US 798682 






(74) Representative: 


(71) 


Applicant: General Instrument Corporation 


HOEGER, STELLRECHT & PARTNER 


IHcrsham, Pennsylvania 19044 (US) 


Patentanwalte 






Uhiandstrasse 14 c 


(72) 


Inventors: 


70182 Stuttgart (DE) 


• 


Safadi, Reem 






Horsham, Pennsylvania 19044 (US) 




(54) 


Methods and apparatus for the provision of user selected advanced closed captions 



CO 

< 

CD 
CO 

CO 
CM 



0. 

UJ 



(57) User custonnlzable advanced closed caption 
capabilities are provided using closed caption informa- 
tion, such as that described in the Electronic Industries 
Association (EIA) Television Data Systems Subcommit- 
tee standards, EIA-608 or EIA-708. The invention allows 
the user to override the closed caption presentation for- 
mat as selected by the originator (e.g., programmer or 
broadcaster), in order to select alternate presentation 
attributes based on the user's preference. The invention 
may also be implemented to customize other forms of 
text infonnation (e.g., subtitles.). The invention also al- 
lows for storage and subsequent retrieval and review of 
text included within the closed caption information, 
which text serves as a transcript of the program. The 
methods and apparatus provided are independent of the 
type of delivery network, content format, and receiver 
type. In an example embodiment, closed caption infor- 
mation is extracted (e.g., by a closed caption processor 
20) from a television signal 10, which television signal 
10 also contains corresponding audiovisual program- 
ming. The processor 20 detenmines whether one or 
more user selected attributes 12 have been set. At least 
one user selected attribute 12 is applied to at least a 
portion of the closed caption infomiation (e.g., via a 
closed caption driver 30). The closed caption informa- 
tion is displayed (e.g., via a display driver 40 and graph- 
ics processor 45) on a display device 50 (e.g., a televi- 



sion screen) in accordance with the user selected at- 
tributes 12 via a graphical overiay on top of the audio- 
visual programming. In this manner, user selected ad- 
vanced closed caption features can be provided using 
existing closed caption infonnation contained in the tel- 
evision signal. 
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